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No studies of Academy of READING® that fall within the scope of the Adolescent Literacy review protocol 
meet What Works Clearinghouse (WWC) group design standards. Because no studies meet WWC group 
design standards at this time, the WWC is unable to draw any conclusions based on research about the effec- 
tiveness or ineffectiveness of Academy of READING® on adolescent readers. Additional research is needed to 
determine the effectiveness or ineffectiveness of this intervention. 

Program Description 1 

Academy of READING® is an online program, originally developed by AutoSkill International, that aims to improve 
students’ reading skills using a structured and sequential approach to learning. The program breaks the task of 
reading into manageable pieces and provides multiple opportunities for practice in five core areas— phonemic 
awareness, phonics, fluency, vocabulary, and comprehension. 

The program’s short, intensive training sessions are designed to fit into class schedules. The initial level of difficulty 
of the material is determined based on a placement test that measures each student’s reading abilities relative to 
his or her grade. The content automatically adjusts based on students’ responses, accelerating training when mas- 
tery is demonstrated or reviewing concepts when needed. Positive feedback and motivational “buddy” characters 
aim to keep students engaged. 

Academy of READING® also measures processing speed, accuracy, and pace of reading. Detailed views of student 
progress allow teachers to track students as they work through the program, alerting them to trouble spots, and 
how much time is being spent on each task. 

Academy of READING® was originally a DOS-based program called the AutoSkill Component Reading Subskills 
Program, and was rebranded in 1995 when it became a Windows-based program. Academy of READING® was 
released in its current form as a web-based program (Version 5.0) in 2004. Academy of READING® is different from 
the Autoskill Component Reading Subskills Program because these programs are branded differently, use different 
technologies and platforms, and have fundamentally different user experiences. AutoSkill International was acquired 
by EPS Literacy and Intervention in 2009. 

Research 2 

The WWC identified 38 studies of Academy of READING® for adolescent readers that were published or released 
between 1989 and 2013. 

One study is within the scope of the Adolescent Literacy review protocol but does not meet WWC group design 
standards. This study does not meet WWC group design standards because the measures of effectiveness cannot be 
attributed solely to the intervention. The study has one unit assigned to both intervention and comparison conditions. 
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Thirty-three studies are out of the scope of the Adolescent Literacy review protocol because they have an ineligible 
study design. 

• Twenty studies did not use a comparison group design or a single-case design. 

• Thirteen studies were literature reviews or meta-analyses. 

Four studies are out of the scope of the Adolescent Literacy review protocol for reasons other than study design. 

• Two studies did not use a sample aligned with the protocol. 

• Two studies did not implement the intervention in a way that falls within the scope of the review because they 
bundled the intervention with other components. 
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Endnotes 

1 The descriptive information for this program was obtained from a publicly available source: the program’s website (http://eps. 
schoolspecialty.com, downloaded February 2014). The WWC requests that developers review the program description sections for 
accuracy from their perspective. The program description was provided to the developer in February 2014, and the WWC incorpo- 
rated feedback from the developer. Further verification of the accuracy of the descriptive information for this program is beyond the 
scope of this review. 

2 The literature search reflects documents publicly available by December 2013. The studies in this report were reviewed using the 
Standards from the WWC Procedures and Standards Handbook (version 3.0), along with those described in the Adolescent Literacy 
review protocol (version 2.1). The evidence presented in this report is based on available research. Findings and conclusions may 
change as new research becomes available. 

Recommended Citation 
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Adolescent Literacy intervention report: Academy of READING®. Retrieved from http://whatworks.ed.gov 
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Glossary of Terms 

Attrition 

Clustering adjustment 
Confounding factor 

Design 
Domain 
Effect size 

Eligibility 

Equivalence 

Extent of evidence 

Improvement index 

Multiple comparison 
adjustment 

Quasi-experimental 
design (QED) 

Randomized controlled 
trial (RCT) 

Rating of effectiveness 

Single-case design 
Standard deviation 


Statistical significance 


Substantively important 


Attrition occurs when an outcome variable is not available for all participants initially assigned 
to the intervention and comparison groups. The WWC considers the total attrition rate and 
the difference in attrition rates across groups within a study. 

If intervention assignment is made at a cluster level and the analysis is conducted at the student 
level, the WWC will adjust the statistical significance to account for this mismatch, if necessary. 

A confounding factor is a component of a study that is completely aligned with one of the 
study conditions, making it impossible to separate how much of the observed effect was 
due to the intervention and how much was due to the factor. 

The design of a study is the method by which intervention and comparison groups were assigned. 
A domain is a group of closely related outcomes. 

The effect size is a measure of the magnitude of an effect. The WWC uses a standardized 
measure to facilitate comparisons across studies and outcomes. 

A study is eligible for review and inclusion in this report if it falls within the scope of the 
review protocol and uses either an experimental or matched comparison group design. 

A demonstration that the analysis sample groups are similar on observed characteristics 
defined in the review area protocol. 

An indication of how much evidence supports the findings. The criteria for the extent of 
evidence levels are given in the WWC Procedures and Standards Handbook (version 3.0). 

Along a percentile distribution of individuals, the improvement index represents the gain or 
loss of the average individual due to the intervention. As the average individual starts at the 
50th percentile, the measure ranges from -50 to +50. 

When a study includes multiple outcomes or comparison groups, the WWC will adjust the 
statistical significance to account for the multiple comparisons, if necessary. 

A quasi-experimental design (QED) is a research design in which study participants are 
assigned to intervention and comparison groups through a process that is not random. 

A randomized controlled trial (RCT) is an experiment in which eligible study participants are 
randomly assigned to intervention and comparison groups. 

The WWC rates the effects of an intervention in each domain based on the quality of the research 
design and the magnitude, statistical significance, and consistency in findings. The criteria for the 
ratings of effectiveness are given in the WWC Procedures and Standards Handbook (version 3.0). 

A research approach in which an outcome variable is measured repeatedly within and 
across different conditions that are defined by the presence or absence of an intervention. 

The standard deviation of a measure shows how much variation exists across observations 
in the sample. A low standard deviation indicates that the observations in the sample tend 
to be very close to the mean; a high standard deviation indicates that the observations in 
the sample tend to be spread out over a large range of values. 

Statistical significance is the probability that the difference between groups is a result of 
chance rather than a real difference between the groups. The WWC labels a finding statistically 
significant if the likelihood that the difference is due to chance is less than 5% (p < .05). 

A substantively important finding is one that has an effect size of 0.25 or greater, regardless 
of statistical significance. 


Please see the WWC Procedures and Standards Handbook (version 3.0) for additional details. 


Academy of READING® December 201 4 


Page 7 


